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Abstract 

Growing attentions have been paid to renewable energy or hybrid energy powered heterogeneous networks 
(HetNets). In this paper, focusing on backhaul-aware joint user association and resource allocation for this type 
of HetNets, we formulate an online optimization problem to maximize the network utility reflecting proportional 
fairness. Since user association and resource allocation are tightly coupled not only on resource consumption of 
the base stations (BSs), but also in the constraints of their available energy and backhaul, the closed-form solution 
is quite difficult to obtain. Thus, we solve the problem distributively via employing some decomposition methods. 
Specifically, at first, by adopting primal decomposition method, we decompose the original problem into a lower- 
level resource allocation problem for each BS, and a higher-level user association problem. For the optimal resource 
allocation, we prove that a BS either assigns equal normalized resources or provides equal long-term service 
rate to its served users. Then, the user association problem is solved by Lagrange dual decomposition method, 
and a completely distributed algorithm is developed. Moreover, applying results of the subgradient method, we 
demonstrate the convergence of the proposed distributed algorithm. Furthermore, in order to efficiently and reliably 
apply the proposed algorithm to the future wireless networks with an extremely dense BS deployment, we design 
a virtual user association and resource allocation scheme based on the software-defined networking architecture. 
Lastly, numerical results validate the convergence of the proposed algorithm and the significant improvement on 
network utility, load balancing and user fairness. 
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I. Introduction 

A. Motivation 

Nowadays, with the proliferation of smartphones, tablets, video streaming, and emerging new appli- 
eations and serviees, the data traffie demand in eellular networks grows tremendously [[I]|, |l2l. To meet 
this demand, cellular networks are trending strongly towards increasing heterogeneity, especially through 
overlapping deployment of small cell base stations (BSs), e.g., microcells, picocells and femtocells, which 
differ primarily in terms of maximum transmit power, physical size, ease-of-deployment and cost flBl-IITlI. 
In fact, it has been widely accepted that heterogeneous network (HetNet) is a promising approach to 
achieve high spectral and energy efficiency. On the other hand, the unprecedented data traffic growth 
and rapidly increasing deployment of small cells have pushed the limits of energy consumption in 
wireless networks, which causes both serious environment problem and sharp rising energy cost for 
network operators |[I1, |[8l- lfTTII . Then, the economic and ecological concerns, together with the advance 
of energy harvesting technologies, have advocated the “green communications” solutions, where cellular 
BSs, especially small cell BSs, are powered by renewable energy sources (RES) such as sustainable 
biofuels, solar and wind energy [011 - 1(141 . Moreover, due to long-term cost savings, easier deployment 
and reduced carbon emissions, HetNets with renewable energy powered BSs can be a sustainable and 
economically convenient solution for next-generation cellular networks. 

As cellular networks evolve into dense, organic and irregular HetNets, load awareness has been elevated 
to a central problem lUSl . Primarily, in HetNets, due to the disparities of transmit powers and BS 
capabilities, even if users are uniformly distributed in geography, the well-known user association schemes 
based on “natural” metrics like signal-to-interference-plus-noise ratio (SINK) or received signal strength 
indicator (RSSI) can lead to an extreme load imbalance among macro BSs and small cell BSs ifT^ . ifTTll . 
Furthermore, the key performance metric for a user should be the rate, not SINR. The rate is of course 
directly related to SINR (e.g., log 2 (l -I- SINR)), but it is also proportional to the fraction of resources 
that the user gets. Thus, heavily-loaded cells may provide lower rate over time, even though they offer a 
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higher SINK IfTSl . As a consequence, a joint user association and resource allocation strategy that is able 
to both introduce load balancing and improve network-wide performance is needed. While for HetNets 
with emerging RES, owning to the dynamics of renewable energy generation and limited capacity of 
energy storage, sole RES may not guarantee enough power supplies for all kinds of BSs. Hence, future 
HetNets are more likely to adopt hybrid energy supplies with both traditional electric grid and RES [|T^ . 
In this case, since the available energy of RES varies with time and space and the average electric power 
consumed by BSs should be limited to save the cost, HetNets call for load balancing strategy that takes 
into account the constrained energy supplies. Moreover, the large number of small cell BSs to be deployed 
in HetNets may incur overwhelming traffic over backhaul links. However, the current small cell backhaul 
solutions, such as xDSE, non-line-of-sight microwave, are far from the ideal ones providing sufficiently 
large data rate lHH, Il20ll . As such, the backhaul (data rate) constraint has become increasingly stringent 
in HetNets. 

B. Related Works 

So far, a lot of works on load balancing for HetNets have been presented. Andrews et al. in [8] survey 
the technical issues and primary approaches on load balancing in HetNets. The works in ETl - CSlI deal 
with joint user association and resource allocation for HetNets powered by grid energy. When it comes 
to HetNets with RES, some studies on user association and/or resource allocation have been presented 
Ifibl - On . Specifically, for HetNets solely powered by RES, [l26ll proposes load balancing scheme among 
different BSs in order to obtain higher downlink network utility, and ETl designs offline and online 
load balancing schemes, which are both energy-aware and QoS-aware. Then, for hybrid energy powered 
HetNets, to reduce on-grid energy consumption by maximizing the utilization of green energy, If2^ presents 
a distributed scheme to enable green-energy aware and latency aware (GAEA) user-BS associations, and 
l(29l formulates and solves a joint multi-stage energy allocation and multi-BS energy balancing problem. 
On the other hand, to strive for a balance between the average traffic delivery latency and green energy 
utilization, ll^ proposes a virtually distributed algorithm, and [|3TI develops a network utility aware 
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(NUA) traffic load balancing scheme. 

Different from the studies only on user association in Itl^ - OTI and the references therein lITSll . this 
paper focuses on joint user association and resource allocation for HetNets. For easy implementation and 
catering to the existing standard model for LTE, unique association of users, which means each user can 
be associated to at most one BS at a time, is considered. This is different from the works in [[24]| and [[25]l . 
where users can be served by multiple BSs simultaneously. Moreover, we take both backhaul and energy 
constraints into account, which is distinguished from the works in [|2T]| - [|^ . [l26ll . Il28l - ll^ . Then, the 
formulated problem has not only mixed integer variables but also coupled variables in the constraints 
of resources, energy and backhaul. Employing some decomposition methods, we efficiently obtain the 
condition for two kinds of resource partition of each BS and develop a completely distributed algorithm 
for user association, which are the novelty and main contributions of this paper. 

C. Contributions 

We deal with the backhaul-aware joint user association and resource allocation problem for hybrid 
energy powered HetNets, which have both backhaul and energy constraints. The contributions of this 
paper are summarized below. 

• We consider a hybrid energy powered HetNet with limited backhaul and take into account the unique 
association of users, which can be easily extended to general energy-constrained LTE HetNets with 
wired or wireless backhaul connections. With the objective of maximizing network utility reflecting 
proportional fairness (PE), we formulate an online optimization problem. However, its closed-form 
solution is quite difficult to obtain in threefold: both binary and continuous variables; tightly coupled 
variables in multiple constraints; and desired distributed solutions for each user and BS. 

• Due to the coupling and non-convexity, we employ several decomposition methods to solve the 
formulated problem. Eirstly, by applying primal decomposition method, we decompose the original 
problem into a lower-level resource allocation problem and a higher-level user association problem. 
Secondly, we further decompose the resource allocation problem into subproblems for each BS. Then, 
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based on complementary slackness property, we efficiently obtain a BS’s optimal resource partition, 
which either assigns equal normalized resources or provides equal long-term service rate to its served 
users. Thirdly, given optimal resource partition of BSs, we solve the user association problem with 
Lagrange dual decomposition method, and develop a completely distributed algorithm for joint user 
association and resource allocation. 

• For the efficient and reliable application of the proposed algorithm to the future wireless networks 
with an extremely dense BS deployment, we design a virtual user association and resource allocation 
(vUARA) scheme based on software-defined networking (SDN) architecture. Since virtual users and 
virtual BSs (vBSs) can be generated in the radio access networks controller (RANG) to emulate 
a distributed user association and resource allocation solution that requires interactive adjustments 
between users and BSs, the proposed scheme significantly reduces the communication overhead over 
air interface and avoids the information leaking to users. 

• We demonstrate the convergence of the proposed distributed algorithm both by applying results of the 
subgradient method in theory and by numerical results with random network realizations. Moreover, 
compared with max-SINR association and range expansion association, numerical results indicate 
that, the proposed algorithm provides a significant improvement on network utility, load balancing 
and user fairness. Furthermore, we present and analyze the effects of energy and backhaul constraints 
on algorithm performance. 

The rest of the paper is organized as follows. We describe the energy-constrained HetNet under 
consideration in Section |nl and formulate the optimization problem in Section |nll The solution to the 
formulated problem is presented in Section |IVl Section |V] gives implementation of the vUARA scheme. 
Simulation studies are provided in Section |Vll and Section IVIII concludes the paper. 
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II. System Model 

A. An Energy-Constrained HetNet 

We consider a HetNet composed of A-tiers of BSs, where each tier models a particular type of BSs. 
For example, let A = 3, then tier 1 consists of traditional macro BSs, tier 2 and tier 3 may be comprised 
of pico BSs and femto BSs, respectively. Generally, macro BSs, pico BSs and femto BSs have different 
transmission power and coverage. Moreover, for BSs of different tiers, their energy consumption and 
backhaul capacities vary widely, and the coefficients of path loss between them and the users are also 
different. All the BSs are assumed to be connected by a high speed backhaul through which information 
exchange with negligible delay is possible. Furthermore, given such a HetNet, we adopt a hybrid energy 
supply, i.e., the BSs are powered by traditional electric grid, RES, or both. For BSs with RES, the RES 
collects energy from the environment by solar panels and/or windmills and charges the corresponding 
battery (each BS has its own RES and battery, which vary with the size of the BS). This is especially 
important in rural areas, where the access to electric grid may be impossible or too expensive. A network 
model for such HetNet with backhaul layout is given in Eig. [H where pico BSs and femto BSs are all 
treated as small cell BSs. 



Fig. 1. Network model 


We denote hy M = {1, 2, • • • ,N} and K, = {1,2, ••• ,iT} the sets of all BSs and all single antenna 
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users, respectively. Each BS in set M schedules transmissions over contiguous time-frequency slots, 
referred to as RBs, each comprising a block of OFDM subcarriers and symbols. Moreover, the transmitting 
power of BS 77. e AA on each RB is assumed to be always constant. 

B. Transmission Model 

According to [|29l|, the duration of one association period, which refers to a time duration in which 
the BSs and the users involved have stable associations, depends on the dynamics of renewable energy 
generation and mobile traffic intensity. Here, we omit the specific definition of these periods, and simply 
denote the association period by index Z G £ = {1, • • • ,L}, and its time duration as In following 
subsections, we focus on the /th association period. 

At time instant t of the Zth association period, we denote the channel power gain between user k E K, 
and BS n G A/" by (t) as 

= GS(«)fS(i). VG, k:)€AfxK. (1) 

where G^^l{t) is the large-scale slow fading component capturing effects of path-loss and shadowing, and 
represents the small-scale fast fading component. “• x •” denotes the Cartesian product of two 
sets. Moreover, it is assumed that C'flit) remains constant during one association period. Thus, it can 
be simplified as To model the small-scale Rayleigh fading, it is assumed that fluctuates fast 

during an association period following an exponential probability distribution function with variance 1 


The instantaneous SINR from BS n to user Zc on a RB is 


sinr|;>(«) 


p(0 p'(0 
-in -i-i. 


nk 


it) 




( 2 ) 


where Pn^ and 


are transmission power of BS n and j on a RB in the association period I, respectively. 


and denotes the thermal noise spectral power. 



Accordingly, the instantaneous achievable rate at user k, if it is served by BS n, can be written as 


fl2(i) = s„iog,(i+siNR;;>(«)), 


( 3 ) 


where Bq denotes the bandwidth over which a RB is realized. 

In general, since the mobility of users between BSs takes place at larger time scales and channel may 
vary during the whole association period, the association decision should be taken considering the long¬ 
term rate that a given user will obtain if it is associated with a certain BS. Referring to ^T2\ . the long-term 
SINR from BS n to user fc on a RB can be written as 


sinrS = 




PX’G 


nk 


p {0^(0 


+ cr2 


and the corresponding long-term rate is 


(4) 


/?2 = i?olog2 (i + SINr2). 


(5) 


On the other hand, the number of users associated with a BS is usually more than one, and the users 
of the same BS need to share the resources. Thus, the long-term service rate achieved by a user depends 
on the load of the BS and will only be a fraction of the rate (unless BS n exclusively serves user 
k in association period 1). That is to say, a user’s long-term service rate for its association with a BS 
depends on both the load and the resource partition method of the BS. In this paper, we assume unique 
association of users and define the user association indicator as 


- 

"''nfc ~ 


1, if user k is associated with BS n, 
0, otherwise. 


( 6 ) 


In addition, denoting the fraction of RBs over which user k is served by BS n as the overall rate 







of user k and the required baekhaul of BS n ean be respeetively given as 




■i&N 




(7) 

( 8 ) 


fce/c 

where Wn is the total number of RBs of BS n, and may vary for different BSs. 
Since the backhaul of BSs is considered to be constrained, for BS n G M, there is 


(9) 


where ^n,bh is BS n’s maximum backhaul capacity that differs considerably among the A-tiers of BSs. 


C. BSs’ Energy Consumption and Constraints 

Firstly, adopting the model in EARTH project ll^ . the energy consumption of BS n in association 
period I can be expressed as 





( 10 ) 


where Pno is the fixed part of BS n’s power consumption, 6n is the variable power consumption slope, 
and dn (j^keic ^nlVnl^ri^ Pn^ is the variable part related to the transmission power and the consumed 
resources. It should be noted that, for BSs belonging to different tiers, their fixed power consumption, 
power consumption slopes and transmission power vary widely [|4||, [|32]|. 

Then, due to RES and batteries adopted by some BSs, we analyze their battery dynamics. 

In order to provide a general model for energy harvesting BSs, we do not assume a particular type of 
energy harvester. Specifically, we assume that BS n is powered by both RES and electric grid. Eet Bn'^ 
and En'^ respectively be the battery level and the renewable energy arriving at the beginning of association 
period 1. Here, En^ can also be viewed as the energy arriving in the association period / — I, but is not used 
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until period 1. This assumption is reasonable sinee, in praetiee, user assoeiation and resouree alloeation 
deeisions ean only be made based on the battery state information available at the beginning of the 
assoeiation period. Besides, it is assumed that, for a larger BS that is powered by RES, the eorresponding 
RES power and battery eapaeity are also larger. 

At the beginning of association period / + 1, the battery level of BS n is updated as 




( 11 ) 


where /(■) depends upon the battery dynamics, such as storage efficiency and memory effects OTTl . cfg 
is BS n’s energy consumption from RES in association period 1. A common practice is to consider the 
battery update as 

=max|0,min|i?«-Ci^^!, + E('+i),i?„^^ (12) 


where i?nmax denotes BS n’s maximum battery capacity, the inner minimization accounts for possible 
battery overflows, and the outer maximization assures the non-negativity of the battery levels. In general, 
^nE be limited by a function of the current battery level, i.e.. 


^(0 

^n,E 




(13) 


where gn\-) limits the renewable energy that can be used in association period I in order to spend the 
energy in a more conservative way. Simply, we can consider that only a given fraction of the battery is 
allowed to be used. 

At the same time, in order to save the cost on electric power, we give BS n’s limited average electric 
power, i.e., the electric grid energy can be used freely on the condition that the average power over all 
association periods is no greater than the threshold Gn,ave [ESI, 


1 

L 


IGC 




< G 


— n,ave 




(14) 
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where = 0, if BS n is solely powered by the eleetrie grid. 

Transforming the average eleetrie power into eaeh assoeiation period and eombining (fT3]) . we have 



^(0 

'^n,E 


+ a 


(0 

n,G 


< sflBi") + G 


(15) 


whieh ean be regard as the energy eonstraint for BS n in assoeiation period 1. 

Remark 1: In the above deseription, we didn’t give any notation indieating the speeifie energy supplies 
of BSs. This is due to the fact that, for BSs without RES, we can set gn\Bn^) = 0; while for BSs without 
energy supplies from electric grid, we have Gn,ave = 0. 


III. Problem Formulation 

In practice, only causal information, i.e., information of the past and current channel states and energy 
harvesting, is available. Thus, an online approach is quite desirable. In addition, based on the analysis 
of BSs’ energy consumption and constraints, we can address the user association and resource allocation 
problem on each association period. In the following sections, the superscript (/) is omitted. 

Firstly, taking a utility function perspective, we assume that user k obtains utility Uk{Rk)- In order 
to achieve a desired balance between network-wide performance and user fairness, we shall choose a 
continuously differentiable, monotonically increasing, and strictly concave utility function. Such that, 
larger rate yields greater utility, and the shape of the concave function also imposes some desired notion 
of fairness. Here, we consider the well-known PF, which is imposed by choosing the utility function 


Uk {Rk) = log (Rk) ■ 


(16) 
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Then, the network utility maximization problem is given as: 


PI : max X] log 1 X] XnkynkRnkWn j 

^ fcS/C \nSiM / 

(17) 

S.t. Xnk = 1, V/C G /C 

neAf 

(17a) 

^ ^ ^nkynk — 1) G TV” 
fce/c 

(17b) 

^ ^ ^nkynkRnk^^n — ^n,h\\i Vri G A/” 
fce/c 

(17c) 

Cn E Qni^Bn) T Vfi G A/” 

(17d) 

Xnk e {0,1}, Vn G A/”, V/c G /C 

(17e) 

ynk e [0, l],Vn G A/”,VA; G /C 

(17f) 


where (17a) denotes that eaeh user ean only be assoeiated with one BS at a given time; (17b), (17e) and 
(17d) respeetively speeify the eonstraints of resources, backhaul and energy for all the BSs; (17e) and 
(17f) keep the association indicators binary and the resource allocation variables being between 0 and 1, 
respectively. 

Since XnkS take binary values and = 1, we have 

^ ^ log I ^ ^ X nkynkRnk^^n 

keM \neAf 

= EE ^nk log (jjnkRnk^^n) • 

k£K n€Af 

Unfortunately, due to binary variables x^k^ and continuous variables i/nfcS, PI is a mixed integer 
nonlinear programming (MINLP) problem, which is generally NP-hard. Moreover, the variables Xnk^ and 
ynk^ are coupled in the constraints of resources, backhaul and energy, which brings much more complexity. 
Furthermore, the optimal solution should be distributed for each user and BS. In the following section, 
we focus on solving PI distributively by employing some decomposition methods. 


Remark 2: The above joint user association and resource allocation problem is a MINLP problem. 
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MINLP problems have the difficulties of both of their sub-classes, i.e., the combinatorial nature of mixed 
integer programming (MIP) and the difficulty in solving nonlinear programming (NLP). Since both MIP 
and NLP are NP-complete, the joint user association and resource allocation problem PI is NP-hard [l34ll . 

IV. Solution 

In this section, the solution to the formulated problem is detailed, and a completely distributed algorithm 
is developed for the backhaul-aware joint user association and resource allocation in energy-constrained 
HetNets. 


A. Primal Decomposition 

Obviously, the choices of i/„fcS rely on the values of XnkS- Given these coupled variables, we can apply 
the primal decomposition method to decompose PI into the following problems in two levels. Firstly, by 
fixing variables we have the lower-level problem: 


^ ^ ^ ^ log (^ynkRnk^^n) 

(19) 



Vnk < l,Vn G AA 

(19a) 

k&Kn 


^ ^ ynk^nk^^n — -^riibh? ^ 

(19b) 

k^Kiri 


\ ^ ^ [yni^Bn) ~\~ G7T,ave] /^ -PnO w ^ \r 

(19c) 

0 < i/nfe < 1, Vfc e /C„, ^neM 

(19d) 


where denotes the set of users that associated with BS n, and |/C„| = 
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Then, when are fixed, the higher-level problem (or the master problem) is given by 


P3 ; max ^ ^ Xnk log {ynkPnkWn) 

(20) 

kaK, ndM 

S.t. Xnk = 1, V/C G /C 

(20a) 


Xnk £ {0) 1})^^ ^ G K, 

(20b) 


Sinee there are no eouplings among the subproblems, P2 ean be further deeomposed into N subproblems 
for all the BSs: 


P4 ; max ^ log (ynkRnkWn) 

(21) 

^ k&Kn 


S't. ^ ^ ynk "G Qn,P 

(21a) 

k&K„ 


^ ^ ynkPnk^^n "Pi Zn,hh 

(21b) 

k&K„ 


0 <ynk< 1, V/C G JCn 

(21c) 


where 


Qn,p = min < 1, 


\_9n(^Bn) T Gn,a\e /S PnO 


SnWnPn 


( 22 ) 


is obtained based on (19a) and (19e), and can be regarded as the normalized resources that BS n can 
afford with constraints from both overall RBs and available energy. 


B. Resource Allocation with Fixed User Association 

Defining Lagrange multipliers /r„ and z/„, the Lagrangian function of P4 is given as 


L 


^ ^ log {ynkPnk^Vn} Fn 

keKn 




(23) 
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Applying Karush-Kuhn-Tucker (KKT) conditions, we obtain 


Vnk 


/i* + P*RnkWr 


■, V/C e ICri 


(24) 


It is easily observed that, Unk is completely dependent on dual variables and z/„. Intuitively, /i„ and 
Un can be interpreted as the prices of BS n determined by load situation and backhaul state, respectively. 
When BS n is overloaded (i.e., Y^keiCn Vnk > Qn,v) or its backhaul is overflowed (i.e., XlfceiCn VnkRnkWn > 
Zn,hh), the corresponding price /in or Vn goes up, then a user /c’s resource fraction ynk from associating 
with it decreases. Otherwise, the prices go down, ynk increases, and BS n becomes more attractive. 

Generally, this KKT system can be solved by finding the appropriate dual variables (/in, z^n)- To achieve 
this, a two-dimensional search or classic constrained optimization techniques such as subgradient method 
or augmented Lagrangian can be applied. However, both of them are computationally intensive and might 
not be practical for large-scale problem. Therefore, in the following, we focus on solving this KKT system 
efficiently based on its specific construction. 

On one hand, we note that both the constraints (21a) and (21b) in P4 are monotonic functions of ynk, 
and ynk is also a monotonic function of /i„ when Vn is fixed and vice versa. On the other hand, the 
complementary slackness in constrained optimization states that, for inequality constraints fi{x) < 0 that 
are tight with equality, the associated dual variables are non-zero. Using this result, at a local optimum, 
each BS can be either energy-constrained or backhaul-constrained. Thus, we can perform our search on 
two single dual variables instead of a two-dimensional search. 

Specifically, if BS n is energy-constrained, i.e., 

'Thk&Kn y^k ~ Qn,v, 

'Yhk&Kn Vnk^nkWn < -^n.bh, 


< 


(25) 



16 


then, there is 

/ 

< 

^: = o. 

V 

Substituting (l24l) and into the first equation of (l25l) . we obtain 

whieh means that BS n assigns equal normalized resourees to its assoeiated users. 
Else if BS n is baekhaul-eonstrained, similarly, there is 


(26) 


(27) 


Vnk 


1 

U^^RnkWn 


Zn,bh 

\ICn\RnkWn 


yk e ]Cn, 


(28) 


whieh means that BS n averages its baekhaul capaeity among the assoeiated users, and all of them aehieve 
equal long-term serviee rate. 

Moreover, in the extreme ease that BS n is both energy-eonstrained and baekhaul-eonstrained, there 
are /r* > 0, u*> 0, and both (1271) and (1281) are satisfied. Thus, we have 


R 


nk 


^n,bh 


,V/c e 


(29) 


whieh implies that all the assoeiated users of BS n have the same data rate. In this ease, BS n assigns equal 
normalized resources to the associated users, and the associated users achieve equal long-term service 
rate. 

In summary, by applying the complementary slackness property, we can efficiently obtain the optimal 
resource partition of BSs. Moreover, since P4 is a convex problem, the local optimum is also the unique 
global optimum. Furthermore, we have the following proposition. 
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Proposition 1: Based on the rates of associated users, BS n can optimally decide its resource partition: 


y*nk 


Qti,P 

IM 


,VA: e /C, 


if < 


|^n|-^n,bh 

WnQn,? ’ 


otherwise. 


(30) 


Proof: Please refer to the Appendix |A] for a proof. ■ 

That is to say, to maximize the network utility, if 'Yhk&Kn ^ divides its normali z ed 

resources constrained by both overall RBs and available energy equally among the associated users; 
otherwise, BS n will average its backhaul capacity, and all the associated users achieve equal long-term 
service rate. 

For clarity, we define BSs’ resource partition indicator vj as: 


07^ 


( 


1 , 




0 , 


\ ' C) ^ jtCnj-^n,bh 

Z^kefCn - W„Qn,P ’ 

Otherwise. 


which will be used in the subsection IIV-DI 


(31) 


C. User Association Given Resource Partition of BSs 

By substituting (1271) and (|2^ into P3 respectively, we can obtain the corresponding solutions for user 
association. Here, taking the resource allocation in (1271) for example, we show the solution in detail. 
Specifically, the corresponding user association problem is: 


. max 2 ^ 2 ^ Xnfc log 1 r , / 

fceXnGAT ^ / 

(32) 

S.t. Xnk = 1, V/c G /C 

(32a) 



Xnk e {0,1}, Vn e TV, Vfc G /C 

(32b) 


P5 is still combinatorial due to binary variables x„fcS. Towards its solution, firstly, a set of auxiliary 
variables = Ylk^K^nk} are introduced; then, to develop a distributed algorithm, we adopt Lagrange 
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dual decomposition method whereby a Lagrange multiplier v is introduced to relax the coupled constraints 

0n 'y^.i.czir ^nki ^ • 

The dual problem can be expressed as: 

F6 G min G{v) = H{v) + I{v), (33) 

where 


H{v) = max EE ^nk \}-0^(^Qn,pRnk^Vn) ^n] (34) 

nGA/” fce/C 

s.t. ^ Xnk = 1, V/c G /C (34a) 

nGA/" 

Xnk e {0,1}, Vn E M,Wk E K. (34b) 

I{v) = max (pn [Vn - log(0n)] • (35) 

4>n<K ^< 


According to the direct observation, H{v) can be further simplified to max [log((5n,p-RnfcbLn) — Vn] 
which means user k chooses one BS to maximize [\og{Qn,pRnkWn) — fn]- It is indeed an algorithm at 
user k’s side, and the optimal user association can be written as 

1 if n = nfc 

Xnk ^ (36) 

0 otherwise, 

where Uk = argmax^ {log{Qn,pRnkWn) - Vn}. 

For I{v), the optimum load pn can be calculated for BS n by applying KKT condition, and we have 

pn = min{exp(t;„ -l),K}. (37) 

This is indeed an algorithm at BS n’s side. 

Note that the dual function G{v) is not differentiable, as H{v) is a piecewise linear function and 
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not differentiable. Therefore, we eannot use the usual gradient methods; instead, we will solve the dual 
problem using subgradient method. 

It is easy to verify that Un{vn) = 4>n — J2kG!c^rik is a subgradient of dual funetion G{v) at point Vn- 
Thus, by subgradient method, we obtain the following algorithm for Lagrange multiplier Vn- 


Vn{t+1) 


Vn{t) - Vn{t) 4>n{t) -^Xnk{t) 


kGK. 


(38) 


where r]n{T) is a positive scalar stepsize, and “+” denotes the projection onto the set of non-negative 
real numbers. 

Similarly, the optimal user association for resource allocation in (1281) can be written as: 


Xnk 



if n = Uk 

otherwise. 


(39) 


where nji = argmax^ {log(Z„^bh) — Vn}, Vn can be updated in the same way as in (l38l) . and has the 
same expression as in (1371) . 

It is easy to see that the multiplier v can be regarded as a message between users and BSs, and be 
interpreted as the service cost of BSs decided by their available resources, energy and backhaul. Moreover, 
it tradeoffs supply and demand, Y^keK^nkit) is deemed the serving demand of BS n and the service 
provided by BS n. In fact, (1381) meets the law of supply and demand, which means that the service cost will 
go up if the demand Yl,k£K^'rik{t) exceeds the supply and vice versa. Therefore, some overloaded BSs 
will increase their service price such that fewer users are associated with them, while other under-loaded 
ones will decrease the service prices to attract more users. 


D. A Distributed Algorithm for Backhaul-Aware Joint User Association and Resource Allocation 

As presented in the above subsections, the formulated backhaul-aware joint user association and resource 
allocation problem is solved distributively through several decompositions. For clarity, the procedure of 
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the problem deeompositions is illustrated as in Fig. [2l Speeifieally, the original problem PI is deeomposed 
into a lower-level resouree alloeation problem P2 and a higher-level user assoeiation problem P3. P2 is 
further deeomposed into subproblems P4 for eaeh BS. Solving P4, the optimal resouree partition for a 
BS is obtained. Given solution to P4, whieh is a funetion of user assoeiation indieators, P3 is transformed 
into P5. Then P5 is solved through Lagrange dual deeomposition, and its dual problem is P6. By solving 
P6 with given solution to the master problem (optimal Lagrange multiplier), the optimal user assoeiation, 
together with the optimal resouree partition of BSs, is determined. 



t 


Primal 


I Decomposition 

I 

T 


t 


I Lagrange Dual 
I Decomposition 

T 


Fig. 2. The problem decompositions 


Based on the above solution, we further present the distributed algorithm for baekhaul-aware joint user 
assoeiation and resouree alloeation in energy-eonstrained HetNets, whieh ean be divided into algorithms 
for eaeh user and BS as in Algorithm [T| and [2l respeetively. 


Algorithm 1 The Distributed Algorithm at User A; G /C 

if f = 0 then 

Estimate Rnk, Vn G Af, by utilizing pilot signals, 
else 

Receive vjnit) and Vn{t), \/n e Af broadcasted by all BSs and choose BS K according to: 

nl =argmax{[log(i?„fcQ„,plU„) - Vn{t)] Wn{t) 

n 

+ [log(Z„,bh) - Vnit)] [1 - tUnit)]} , 

If there is more than one optimal association at the same time, a user can choose any one of them. 
Feedback association information Xn*kif) = 1 to BS n*^. 

end if 
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Algorithm 2 The Distributed Algorithm at BS n G AA 

if t = 0 then 

Initialize resouree partition indieator Wn{^), stepsize ?7n(0) and i2n(0). 

else 

Reeeive assoeiation information Xnk{t) = 1, V/c G /C, determine the resouree partition and update 
Wn{t+ 1) aeeording to 


Wn{t + 1 ) 


'^^Ylik&K^rikif)Rnk^ VF„Q„’p 

0, otherwise. 


Caleulate 0n(f) via 


= minjexp {vn{t) - 1) , K}. 


Update Lagrange multiplier Vn(t + 1) via 


V, 


lit + 1 ) — 


V, 


.it) 



k£lC 


^nk it) 


Broadeast the new zunit + 1) and Vnit + 1) to all users. 

end if 


Aeeording to the above Algorithm [T] and [2l in eaeh iteration, eaeh user reports its serviee request to 
only one BS to whieh it expeets to eonneet, and eaeh BS adjusts its serviee eost only relies on loeal 
information and then broadeasts it to all users. Therefore, the distributed method owns the amount of 
exehanged information of 0{N + K) for eaeh iteration, and the algorithms at a user’s side and a BS’s 
side have eomputation eomplexity of 0{N) and 0{K), respeetively. Due to high eonvergenee speed of 
the distributed algorithm, the iteration number is small. Consequently, the distributed algorithm may be 
more praetieable for some eases, espeeially for large-seale problems, even if there exits more exehanged 
information. 

After earrying out the algorithms at eaeh user’s side and eaeh BS’s side, the distributed algorithm ean 
be guaranteed to eonverge, whieh will be proved by employing results of the subgradient method [1^ in 
the following proposition. 

Proposition 2: Let v* denote an optimal value of the dual variable. With eonstant stepsize, the proposed 
distributed algorithm is proved to eonverge statistieally to v*, i.e., for any e > 0, there exists a stepsize rj, 
sueh that limsupj_^(^ G (r2(t)) — G{v*) < e, where v{t) = j while for diminishing stepsize. 
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the distributed algorithm is guaranteed to eonverge to the optimal value. 

Proof: Please refer to the Appendix |B] for a proof. ■ 

Therefore, based on results on eonvergenee of the subgradient method, for eonstant stepsize, the 
proposed algorithm is guaranteed to converge to within a neighborhood of the optimal value; while for 
diminishing stepsize, the algorithm is guaranteed to converge to the optimal value. Moreover, since we 
focus on constant stepsize for theoretical proof, we will show the convergence with diminishing stepsize 
by numerical results in Section |Vll 

V. Implementation Based on SDN 

Although the proposed algorithm has provided a distributed user association and resource allocation 
solution, its application to the future wireless networks with an extreme BS deployment may still be 
inefficient due to the required interactive adjustments between users and BSs. In this section, based on 
the newly emerged SDN architecture, we design a vUARA scheme, which reduces the communication 
overhead over air interface and avoids the information leaking to users. 

In the design of next-generation wireless networks, the challenges faced by current network architectures 
cannot be solved without a radical paradigm shift. Recently, by utilizing SDN, some architectures, such 
as software-define radio access network (SoftRAN) lf3^ and SoftAir llJTl . have been proposed. Briefly, 
these architectures can accelerate the innovations for both hardware forwarding infrastructure and software 
networking algorithms through control and data separation, enable the efficient and adaptive sharing of 
network resources through network virtualization, achieve maximum spectrum efficiency through cloud- 
based collaborative baseband processing and enhance energy efficiency through the dynamic scaling of 
computing capacity of the software-defined BSs llJTl . Therefore, based on these architectures, we design 
a vUARA scheme. Mainly, by leveraging cloud computing and network virtualization, virtual users and 
vBSs can be generated in the radio access networks controller (RANG) to emulate a distributed joint user 
association and resource allocation solution that requires network measurements and iterative adjustments 


between users and BSs. 
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The implementation of vUARA is shown in Fig. [2l Generally, it eonsists of three phases. The first 
phase is the initial user assoeiation and network measurements, during whieh the users and BSs measure 
and report their downlink SINRs, available energy and baekhaul eapaeities to the RANG. In the seeond 
phase, the RANG firstly generates virtual users and vBSs, and then simulates the iterative user assoeiation 
and operation statuses (reflecting resource partition, load, and price of access) adjustments between users 
and BSs based on the information collected in the first phase. When the iterations converge, optimal cell 
association of users and resource allocation of BSs are derived. In the third phase, the RANG informs 
individual users and BSs about cell association and resource partition decisions. The major optimization 
of the vUARA scheme is done in the second phase. To be analytically tractable, we assume that (1) the 
RANG can successfully collect network information from all BSs and users, and (2) the data rates of 
users do not change within one user association process. 


r 


\ 


BSs 


Available energy and 
backhaul capacity ^ 

Downlink SlNRs ^ 


RANG 



vUARA 


vBSs 


Virtual 

users 

L_ 




to BSs 

and users _| 


-1st phase- 


* 4 ^ 


-2nd phase- 


►M3rd phas' 




Fig. 3. The implementation of vUARA 


In summary, firstly, it is the RANG that jointly optimizes the user association and resource allocation 
based on network measurements. Secondly, instead of exchanging information over air interface that may 
introduce additional communication overhead and incur extra power consumption, the virtual users and 
vBSs can iteratively update their BS selections and operation statuses via a wired link, e.g., a message bus. 
Lastly, with vUARA, on one hand, the communication overhead over air interface is significantly reduced; 
on the other hand, the virtualization avoids leaking BSs’ information to users since all the iterations are 


simulated in the RANG. 
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VI. Performance Evaluation 

In this section, we evaluate the performance of the proposed backhaul-aware joint user association and 
resource allocation algorithm for energy-constrained HetNets. Specifically, a 3-tier HetNet composed of 
one macro BS and several small cell (micro, femto) BSs is considered. The location of the macro BS is 
fixed and it forms a conventional cellular structure, while other small cell BSs are randomly located in an 
orthohexagonal area with side length 500m. We assume that there exist two kinds of users in the scenario, 
i.e., hotspot users and random users. The former are located in the vicinity of each BS and the number 
of them is fixed, while the latter are randomly deployed in the whole area with varying number (denoted 
by iTrand)- The simulation topology is given in Fig. IH Moreover, the energy and backhaul constraints of 
each BS and other basic parameters are presented in Table H It is noted that, since the proposed algorithm 
deals with joint user association and resource allocation with energy constraints in an association period, 
we consider the overall energy constraint of a BS without its specific components. 



Fig. 4. Simulation topology 







TABLE I 

The basic parameters 
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Parameter 

macro BS 

micro BS 

femto BS 

Number 

1 

4 

10 

Hotspot users 

25 

10 

5 

PnO (W) 

130 

56 

4.8 

Sn 

4.7 

2.6 

8.0 

Output power (dBm) 

46 

35 

20 

Path loss (dB) 

34 + 401ogio(d) 37 + 301ogio(d) 

Wr. 

500 

100 

50 

Available Energy (J/s) 

300 

65 

5.6 

ZrL,bh (Mbps) 

2000 

200 

20 

(T^ (dBm) 


-111.45 



A. Convergence 

Given one random network realization, Fig. [5] presents the Lagrange multiplier v and network utility 
versus iterations. Speeifioally, the dashed lines refer to BSs’ Lagrange multipliers with random initial 
values and distinct convergence process, and the solid line shows the network utility in terms of users’ 
long-term service rate. Since the values of Lagrange multipliers and network utility are widely divergent. 
Fig. [5] adopts double ordinates, i.e., left ordinate and right ordinate, to refer to them respectively. The 
convergence of the proposed algorithm is demonstrated in Fig. [51 Moreover, it is also shown that, the 
proposed algorithm may have a very fast convergence rate when parameters are set properly. 



Fig. 5. Lagrange multiplier v and network utility versus iterations (Js'rand = 100) 
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B. Comparisons with Max-SINR and Range Expansion 

To demonstrate the superiority of the proposed algorithm, we compare it with the common user 
association schemes, i.e., max-SINR association, which associates users to the BS with the highest received 
SINK, and range expansion association, where the idea is to add a cell selection offset to the reference 
signals of the small cells in order to offload some traffic from the macrocells. Considering the energy and 
backhaul constraints, for max-SINR association and range expansion association, we adopt equal resource 
allocation among the users associated with the same BS and maximal achievable rate first (MART) 
scheduling [fT^ that selects users in descending order of achievable rates, given backhaul constraints. In 
addition, since the best offset (or biasing) factor is very difficult to obtain, here, we use offsets of lOdB 
and 12dB for micro BSs and femto BSs, respectively. All the following results are averaged over 10^ 
random network realizations. 

Given varying number of random users and small cell BSs, firstly. Figs. and |7] respectively present 
the network utility and percentage of users associated with macro BS with the above three association 
methods. Specifically, Fig. shows the significant improvement on network utility with the proposed 
algorithm, while the network utility with both max-SINR association and range expansion association 
is very low. Then, in Fig. |71 it is easy to see that the percentage of users with the proposed algorithm 
is the lowest, while with the max-SINR association is highest. These facts confirm that (1) the max- 
SINR association will lead to very unbalanced load among BSs and greatly degraded network utility; (2) 
the range expansion association leads to better load balancing, but the improvement of load balancing 
may not overwhelm the degradation in SINR that certain users suffer; (3) the proposed algorithm gains 
significant improvement on both network utility and load balancing, since it takes both energy and backhaul 
constraints into consideration, and jointly optimizes the user association and resource partition. Moreover, 
it is obvious that, with fixed number of small cell BSs and moderate increase of the number of random 
users, the network utility increases given the above three association schemes, while the percentage of 
users associated with macro BS decreases. On the other hand, with more small cells deployed, all the 
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association schemes achieve much better performance in terms of both network utility and load balancing. 


Fig. 6. Network utility 
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Fig. 7. Percentage of users with macro BS 


Then, to measure the status of users’ long-term service rates, we introduce the Jain’s fairness index, 
that is, p = larger p that belongs to the interval [1/i^, 1] means more 

balanced long-term service rates among the users. Given the above three association schemes. Fig. [8] 
presents fairness index among long-term service rates of users. It is observed that, (1) the fairness index 
of the proposed algorithm is much greater than that of either max-SINR association or range expansion 
association; and (2) compared with max-SINR, the fairness index of range expansion association is only 
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a little higher. These are due to the faets that, on one hand, the proposed algorithm jointly optimizes 
the user assoeiation and resouree alloeation under eonstraints of resourees, energy and baekhaul; on the 
other hand, the offset faetor set here may be far from the “best”, whieh degrades the performanee of 
the range expansion assoeiation. Moreover, it is worth mentioning that, for max-SINR assoeiation and 
range expansion association with equal resource allocation and MART scheduling, some users may be 
dropped since their BSs are running out of backhaul; while with the proposed algorithm, all the users are 
accommodated. In addition, both the number of users and that of small cell BSs have impacts on user 
fairness, that is, for the proposed algorithm, both the increased deployment of small cells and decreased 
access of users improve the user fairness. While for max-SINR association and range expansion association, 
the increase of the number of small cells will not improve the user fairness index, which further proves 
that these two association schemes have little help in providing user fairness. 



Fig. 8. Fairness index among long-term service rates of users 


C. Effects of Energy and Backhaul Constraints 

Since constraints of both energy and backhaul are taken into consideration, we illustrate their effects 
on algorithm performance. All the results are averaged over 10"^ random network realizations. Firstly, Fig. 
|9] shows the network utility and percentage of users with macro BS versus ratio between the available 
energy and that in Table HI We can see that, with the increase of available energy at each BS, the network 
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Utility firstly increases then stays almost unchanged due to backhaul constraints. While the percentage of 
users associated with macro BS firstly decreases since more users will associate with the small cell BSs 
once they have more or enough energy. However, because of the backhaul constraints, the percentage may 
not keep on decreasing. Then, the network utility and percentage of users with macro BS versus ratio 
between the backhaul capacities and those in Table U are given in Fig. [TOl It is observed that, with the 
increase of backhaul capacity at each BS, firstly, the network utility increases rapidly, while the percentage 
of users with macro BS remains almost unchanged; then the network utility has slower increase, while the 
percentage decreases. This is due to the fact that, at the beginning, all the BSs may be greatly constrained 
by their backhaul, thus, with the increase of backhaul capacities, the network utility increases fast, while 
the percentage of users with macro BS may not decrease; then, when backhaul capacities are large enough, 
available energy becomes the constraints for all the BSs, especially for macro BS, as a result, the network 
utility may not keep on increasing, while the percentage of users with macro BS decreases. However, Figs. 
|9] and [10] only show the rough tendency with the increase of available energy and backhaul capacities, 
respectively, and the results greatly depend on the parameter settings given in Table jH 



Fig. 9. Effects of energy constraints (FCrand = 100) 

Moreover, in Figs. [H] andthe network utility and percentage of users with macro BS are respectively 
presented with varying constraints of energy and backhaul. Particularly, the change of energy and backhaul 
constraints is the same as that in Figs. |9| and HOl respectively. It is observed that, with fixed backhaul 
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Fig. 10. Effects of backhaul constraints = 100) 


(energy), the network utility and pereentage of users with macro BS have the same tendency as those in 
Fig. |9] (Fig. [To]). Besides, Figs. [U] and O also show that, compared to the network utility improvement 
with increasing backhaul capacities of all the BSs, the network utility increases rapidly with the increase 
of available energy; and the percentage of users with macro BS reduces much faster with increasing 
available energy of all the BSs, compared to its change with the increase of backhaul capacities. These 
may due to the fact that, the available energy of BSs affects the algorithm performance together with 
the available resources of BSs. Thus, much greater impacts are observed. Nevertheless, the constraints 
of both backhaul and energy affect the algorithm performance, and the impacts relate to the parameter 
settings given in Table HI In a word, the specific effects of energy and backhaul constraints are coupled 
and complicated; the network design should take both of them into account. 

VII. Conclusions 

In this paper, given a HetNet powered by hybrid energy, we focus on the backhaul-aware joint user 
association and resource allocation problem. To balance network-wide performance and user fairness, 
we formulate an online network utility maximization problem reflecting PF, which has tightly coupled 
variables (both binary and continuous) in the constraints of resources, energy and backhaul. Then, by 
adopting some decomposition methods, the condition for two kinds of resource partition of a BS is 
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Fig. 11. Effects of energy and backhaul constraints on network utility (ifrand = 100) 
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Fig. 12. Effects of energy and backhaul constraints on percentage of users with macro BS (Ffrand = 100) 


efficiently obtained, and a completely distributed algorithm is developed. Finally, the convergence of the 
distributed algorithm is proved by employing results of the subgradient method. Moreover, based on 
SDN architecture, we develop a vUARA scheme for future wireless networks with an extremely dense 
BS deployment. Lastly, numerical results indicate that, compared with max-SINR and range expansion, 
the proposed algorithm provides a significant improvement on network utility, load balancing and user 


fairness. 
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Appendix A 


Proof of Proposition 1 


If BS n is energy-constrained, according to (l27l) and the second inequality of (l25l) . we have 



(40) 



(41) 


_^ I ^ I ^ 

which means that, to maximize the network utility, if ^ divide its available 


resources equally among the associated users; otherwise, BS n is backhaul-constrained, and according 
to (1281) . it will average the backhaul capacity and provide all the associated users with equal long-term 
service rate. 

Appendix B 

Proof of Proposition 2 

Given constant stepsize r]n{t) = t], according to the updating of v, we have 


v(t + 1) 



\[v{t) - - V* 


2 


2 


< ll'D(f) — r]u{t) 



( 42 ) 


v{t) 



2riu(ty {v(t) — v*)+ri'^ ll'“(^)ll 


2 

2 





2r] (G{v{t)) - G{v*)) + Tf ||w(f)|| 


2 

2 > 
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where the last inequality follows from the definition of subgradient. Applying the inequalities reeursively, 
we obtain 


t 

1=1 

t 

<-\\v{t + l)-v*\\l + \\v{l)-v*\\l + J2v‘^ \\u{l)\\l (43) 

1=1 

t 

1=1 


From this inequality, we have 


1 

t 


E 





Eli^ 11^(0112 

2t 


Sinee G{v) is a eonvex funetion, by Jensen’s inequality, there is 







V 


2tr] 


+ 


Ehv 


u 


2t 


(44) 


(45) 


When both 0n(O and Ylk=i^nk{l) are bounded, ||tt (/)||2 is bounded too, i.e., sup ||'u (/)||2 < c , where 


c is a sealar. Then, 


Giv{t)) -G{v*) < 


1 ^( 1 ) -^^"112 , VC 


2tr] 




(46) 


Therefore, limsupj^(,oG yv{t)j — G{v*) < e, where e = ric/2. That is to say, given eonstant stepsize, 
the algorithm eonverges statistieally to within 770/2 of the optimal value. Besides, if stepsize 77 is small 
enough, the algorithm eonverges to the optimal value. 
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